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1.0  Introduction 

The  Technical  Cooperation  Program  (TTCP)  is  a  joint  program,  between  the 
Governments  of  Australia,  Canada,  New  Zealand,  the  United  Kingdom  and 
the  United  States  of  America,  to  share  the  results  of  military  research 
and  development.  The  program  is  split  into  various  Subgroups  of  which 
Subgroup  S  is  concerned  with  Communications.  Subgroup  S  has  various 
Technical  Panels  and  STP-5  (Communications  Networks  Architectures)  has 
been  tasked  with  addressing  the  issue  of  Communications  Network 
Management. 

At  the  19th  meeting  held  at  the  Naval  Ocean  Systems  Center,  STP-5 
concluded  that  a  Network  Management  Workshop  should  be  conducted.  The 
USA  (Rome  Air  Development  Center)  undertook  to  organize  the  1987 
Communications  Network  Management  Workshop  which  was  held  on  30th  June  - 
2nd  July  at  the  Sheraton  University  Conference  Center,  Syracuse,  NY. 

2.0  Proceedings 

The  presentations  were  structured  into  the  following  sessions: 

Overview  of  US  Department  of  Defense  Networking  Problems 

Link  Management 

Node  Management 

Network  Management 

User  Management. 

It  is  not  proposed  to  describe  in  detail  the  proceedings  of  the 
workshop  as  the  agenda  may  be  found  in  Appendix  A,  the  list  of  attendees 
in  Appendix  B  and  the  materials  provided  by  the  presenters  in  Appendix  C. 

Some  themes  emerged,  however,  which  were  discussed  throughout  the 
workshop  and  which  merit  further  discussion: 

Management  of  Heterogeneous  Networks 

Stability  of  Routing  Algorithms  and  new  research  techniques 
for  investigating  adaptive  routing 

Security 

Knowledge-Based  Systems 

The  distinction  between  Macro  and  Micro  Management  of  Networks. 
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2 . 1  The  Management  of  Heterogeneous  Network  s 

The  management  of  heterogeneous  networks  is  a  ciitf  icult  task .  The  man¬ 
agement  system  must  he  able  to  deal  with  -.■  variety  of  manufacturer’s 
products  as  well  as  a  variety  of  networking  techno1 ogies  (e.g.  packet, 
voice)  and  multiple  transmission  media  (e.g.  fioer,  HF ,  etc.)-  f*  single 
manufacturer's  solution  will  not  be  viable  due  to  the  2Aistence  or  an 
installed  base  of  diverse  equipment  arid  to  laws  against  such  non¬ 
competitive  activity.  This  is  a  real  problem  now  as  h.e  military  uses 
public  networks,  each  with  its  own  proprietary  management  systems. 
Network  Management  standards  are  port  of  ♦'he  long  term  answer  to  such 
problens  but  current  timetables  predict  that  the  majority  wilt  noc  ’-each 
draft  International  Standard  ( D I S )  status  until  about  1990. 

The  various  network  management  systens  forming  an  internetwork  must 
work  in  a  cooperative  manner.  Correlation  of  exceptions  across  networks 
to  aid  the  management,  process  is  one  area  which  has  received  little 
attention.  It  would  be  useful,  for  instance,  to  be  able  to  detect  co¬ 
ordinated  attacks  on  tne  different  networks  used  to  communicate  with  a 
particular  site. 

2  . 2  Stab 1 1  i  ty  of  Uout  i r,j  Algorithms 

To  date,  algorithms  used  for  activities,  such  as  routing,  have  concen¬ 
trated  on  optimality  with  respect  to  certain  assumptions  son i icable  to 
commercial  networks.  The  requirements  of  military  scenarios  have  not 
necessarily  been  considered.  Management  activities  should  be  able  to 
deal  with: 


1.  mobile  network  nodes. 

2.  extreme  traffic  surges  and  variations  by  being  responsive  and 
stab  ie. 

d,  rapid  reconstitution  ar.d  reconfiguration  of  available  communi¬ 
cations  assets  (currently  it  is  difficult  to  determine  the 
current  state  of  a  failing  network). 

4.  coordinated  attacks  in  a  highly  survivable  manner.  The  net¬ 
work  siioold  be  more  offensive  and  less  reactive.  For  example, 
upon  detecting  a  degraded  channel  it  could  use  the  channel  for 
voice  ra^he-  than  data.  It  should  report  details  of  the 
jamming  and  in  extreme  cases  continue  to  send  dummy  traffic. 
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Adaptive  routing  research  should  continue.  The  idea  of  marrying 
perturbation  analysis  and  simulation  has  developed  a  useful  technique 
for  modelling  -outing.  Several  of  tne  routing  algorithms  which  are 
currently  being  used  (as  well  as  new  ones)  should  be  compared  in  terms  of 
stabi 1 i ty  and  speed. 
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2.3  Securit 


The  topic  of  Network  Security  was  frequently  raised.  Two  issues  emerged. 
Firstly,  the  Security  Services  of  the  network  need  to  be  managed. 
Secondly,  the  network  management  service  must  be  secured  as  must  the 
information  used  within  the  network  to  make  routing  decisions.  The  ISO 
standards  committees  are  concentrating  only  on  the  second1  of  these  and 
require  more  technical  input  in  this  area.  A  related  topic  is  that  of 
centralized  versus  distributed  management.  Centralization  provides  a 
more  complete  view  of  network  operations  but  creates  a  vulnerable  point 
for  attacks. 


2.4  Knowledge-Based  Systems 


Knowledge-based  systems  continue  to  attract  interest.  They  are  viewed 
as  potential  aids  in  reducing  the  complexity  and  data  volume  of  managing 
networks.  They  must,  however,  be  capable  of  assimilating  subtle  trends 
like  daily  traffic  patterns  if  they  are  to  be  useful  as  diagnostic  and 
management  aids. 


Macro  and  Micro  Management 


It  was  clear  that  on  many  network  management  issues  there  were  two  points 
of  view.  Firstly,  the  user's  high-level  generally  long  term  policy 
requirements  for  the  performance  of  the  network  (Macro  Management). 
Secondly,  the  network  Implementor's  automatic,  low-level,  immediate 
mechanisms  for  network  management  (Micro  Management).  The  Micro 
Management  activities  should  implement  the  Macro  Management  policy. 


The  workshop  ended  with  a  discussion  period  centered  around  the 
questions: 


What  is  Military  Network  Management  to  a  military  commander? 

What  is  Military  Network  Management  to  a  network 
maintainer /provider? 

What  is  Military  Network  Management  to  an  equipment  manufac¬ 
turer? 


The  nature  of  the  questions  reflect  the  fact  that  the  military  needs 
for  network  management  need  to  be  better  understood.  Once  this  is 
achieved  it  is  hoped  that  the  manufacturers  will  provide  products  which 
better  meet  those  needs. 


^The  March  1987  draft  of  ISO  7498/Part2  -  Security  Architecture 
addresses  the  management  of  the  Security  Service 


3.0  Areas  of  Future  Work 


As  a  result  of  the  workshop  it  was  agreed  that  the  following  areas  would 
benefit  from  the  application  of  more  Research  and  Development: 

1.  The  Management  of  Heterogeneous  Hardware,  Network  Technologies 
and  Transmission  Media.  This  implies  the  need  for: 

Flexible  generic  tools  which  can  be  configured  to  manage 
diverse  existing  equipments  to  provide  a  homogeneous  Manage¬ 
ment  Interface 

International  Network  Management  Standards 
An  Open  Network  Management  Architecture 

The  ability  to  exercise  Network  control  and  monitoring  across 
networks 

The  ability  for  "peer  level"  management  entities  to  negotiate. 

2.  The  Differentiation  and  Integration  of  Macro  and  ’licro  Network 
Management.  Not  only  in  the  area  of  routing  but  also,  for  instance,  the 
gathering  of  Statistics,  the  issues  of  Global  Views  versus  Detailed 
Granularity. 

3.  The  issue  of  low-level  routing  and  network  control  would 
oenefit  from  the  application  of  the  marriage  of  perturbation  analysis 
and  modelling.  Concerns  in  this  area  include  the  control  of  extreme 
traffic  load  variations,  f ragmentation  and  reconstitution  of  networks 
and  the  stability  of  networks. 

4.  The  application  of  Knowledge-based  Technology  to  Network 
Management. 

5.  What  will  be  the  impact  of  Photonics  (the  replacanent  of 
electronic  devices  by  Optical  processing  components)  on  network 
management? 

6.  The  Security  of  networks  -  Loth  the  Security  of  the  Management 
Information  and  th0  Management  of  the  Security  Service  Methods  to 
recognize  sophisticated  attacks  o:i  networks. 

7.  Support  should  be  given  tc  the  standards  making  bodies  in  the 
form  of  technical  input,  to  ensure  that  standards  for  the  management  of 
Network  Security  are  both  tir.viy  and  useful.  This  issue  is  urgent  due  to 
the  long  timescale  of  the  standards  making  process  and  the  small  window 
of  opportunity  which  exists  to  influence  the  next  standard. 


4.0  Summary 

The  1987  Network  Management  Workshop  was  very  successful  as  evidenced  by 
the  fact  that  approaximately  100  people  attended.  In  all,  over  30 
presentations  were  given  by  government,  industry  and  academia.  Because 
of  its  success,  it  is  proposed  that  this  event  should  be  held  annually. 
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ISSUES  IK  LINK  NAKACEKENT 

J.  A.  Hoffmeyer 
Department  of  Commerce 
Institute  for  Telecommunication  Sciences 
Boulder,  Colorado  80303 


the  Institute  for  Telecommunication  Sciences  has  had  a  long  history  In 
propagation  "research  and  transmission  systems  engineering.  Much  of  this 
activity  has  been  in  support  of  military  communications  systems  design, 
development,  and  testing.  Although  numerous  technical  Issues  remain  In  these 
areas,  new  research  programs  are  now  needed  In  the  area  of  adaptive  networks 
which  provide  survlvable,  endurable  complications  under  a  variety  of 
operational  conditions. 

The  subject  of  adaptive  network  design  Is  both  broad  and  complex  The 
vievgraphs  provided  are  relevant  to  only  one  pert  of  the  problem- -  that  of  link 
management.  The  ITS  does  not  currently  have  an  ongoing  research  program  which 
addresses  the  many  problems  in  adaptive  link  management.  However,  there  are 
several  programs  at  ITS  which  are  relevant  to  some  of  the  key  issues  In  link 
management. 

The  first  two  viewgraphs  (ITS-1  and  TTS-2)  serve  the  purpose  of  introducing 
both  the  topic  and  the  Institute  for  Telecomsunication  Sciences  This  is 
followed  by  three  viewgraphs  (ITS-3  through  ITS  5 )  that  provide  one  view  of  the 
objectives  and  key  issues  in  link  management.  The  general  objective  is  to 
develop  communications  links  that  are  survlvable,  rv>.able  and  provide  adequate 
service  performance,  and  that  can  adapt  to  the  operational  anvironment.  This 
can  be  achieved  through  Che  use  of  multimedia  transmission  links,  distributed 
intelligence  at  the  neework  nodes,  the  use  of  artificial  intelligence,  adaptive 
routing,  acc. 

Key  issues  include  the  definition  of  requirements,  the  design  and  development 
of  adaptive  algorithms  for  use  at  the  intelligent  nodes,  and  the  testing  of 
these  algorithms.  Testing  must  be  preceded  by  the  definition  of  performance 
measures  to  be  used.  Some  examples  of  different  types  of  performance  measures 
are  provided  in  viewgraph  ITS -6. 

The  next  five  viewgraphs  (ITS-?  through  ITS-ll)  describe  some  ongoing  programs 
at  ITS  which  are  believed  to  be  relevant  to  che  issues  described  ir.  Che 
preceding  viewgraphs.  ITS  has  developed  a  1  ine -of - sighc  microwave  channel 
simulator  Chat  Is  capable  of  simulating  multipath  fading  conditions  (see 
References  1  and  2).  We  have  also  developed  che  Transmission  Monitor  and 
Control  Software  (see  viewgraph  ITS-10  and  References  3  and  »i,  and  an 
algorithm  which  models  the  error  distributions  of  a  variety  of  channu.s  <  see 
viewgraph  ITS-ll  and  References  5  and  6), 

The  ITS  is  currently  developing  a  link  simulation  facility  (viewgraph  ITS  -12; 
which  is  believed  to  be  pertinent  to  che  investigation  of  link  management 
issues  (viewgraph  ITS- 13).  Tha  outline  of  a  suggested  link  management  research 
program  is  provldad  in  vlevgrapn  ITS ■ Iw . 
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EXAMPLES  OF  PERFORMANCE  MEA3URES 
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Heuristic  Simulation  Result 


The  following  paragraph  is  an  abstract  or  introduction  to  the  paper. 


SURVIVABILITY  OF  COMMUNICATIONS  IN  EUROPE 

by 

Walter  C.  Kinzlnger 
The  MITRE  Corporation 
McLean,  Virginia  22102 


This  paper  addresses  the  survivability  of  the  U.S.  Defense 
Conmunications  System  (DCS)  in  Europe.  The  DCS  is  a  multi -country, 
theater-wide  network  that  provides  backbone  communications  among  the  major 
U.S  headquarters  and  also  connects  to  the  CONUS.  The  DCS  includes  the 
AUTOVON,  AUTODIN.  AUTOSEVOCOM  and  more  recent  programs  such  as  OEB,  ETS, 
OSN,  and  DON.  This  paper  responds  to  a  growing  concern  that  the  DCS  be 
capable  of  meeting  the  challenge  of  a  wartime  role.  The  issue  is  whether 
or  not,  within  affordable  budgets,  there  is  a  fixed  conmunications  network 
architecture  structure  that  will  provide  adequate  user  connectivity  in  a 
major  European  theater  conflict.  Although  the  analysis  addresses  the 
European  theater,  the  conclusions  derived  apply  more  broadly. 


Thank  you  for  this  opportunity  to  discuss  publicly  some  of  the  basic 
ideas  that  need  to  be  Incorporated  into  combat-ready  military  network 
design. 

Walter  C.  Kinzlnger 
Associate  Department  Head 
Worldwide  Communications  Systems 
(703)  883-7475 

WCK/1 ac 


C-140 


"■r.'-rp.-: 


BEQUEST  FOB  PUBLIC  BE  LEASE  OF 
UNCLASSIFIED  TECHNICAL  INFORMATION 


-ufrucnons: 

•  Complolo  form  alter  rata 

•  Submit  farm  intact  to  **• 


rafarrtnq  to  tnatnicSom  on  i 


AS*.  PAP  Fie.  and  MfTK  Social*  Proewduot.  Vbl.  1.  Soct.  L 
Odloo.  •  Allow  *  wwota  for  toullno  proo— tnq. 


1  Ho.  Capioi  Attochod 

Original  ♦  3  copits 

4  Onto  et  Oocumord 

2  August  1982 


7  AuOwru) 

Walter  C.  Klnzl  tiger 


Survivability  of  rn— unications  In  Europe 


5  ftolacl  Nwnbor 

38 1A 


11  Approval  aaquawod  For 

SO m  (and  '■teuao  nmmioii Onn  (no  «woin 
teuton  Ajtxicoilon  at  *<•  M Mod  (Smiay) 


IS  to  to  SuMMitea  to  (SdOor/Owaman  Homo  and  / 

Bernard  DaMarlnls 
Booz,  Allan  I  Kami 1  ton 


1 14  tar  Hjeuoddon  n  or  noowOBdon  to. 

AFCEX  Syeposlva  at  Fort  NonmC 
New  Jersey  '  .  . * 

— -  I  I  ' 


Approval  Signatures 


LIa 


DESIGN  OBJECTIVES 


y-'As-'S 

'■J'v'SM 

*  "A  ■  *  "  &  .*] 


LUlS 

9b 

>3 

SFO 

0.00 

l-UJ 


53 

COLL 

yz 

§o 

oco 

LU  < 

p 

<o 

^  LU 

ocz 

oz 

£0 

hO 

2c O 
H4J 
Ob 
LU  *< 
_J  UJ 

luce 

co  O 


==  CO 


U-3 

OO 

UjQC 

coo 

bw 
ft  co 

w  < 

CQ  LU 
LU-I 
*□ 
<  z 


,v\vV- 
<»  ■%.  /. 


gdfel 

v'y'tyty 

•*'*3 

V  .  f  \:  i 

•wv 

81 


.'.N’.V.V'S 

.V 


»  ■’,  ■■»  -<1 
»./■  ^  V] 
1  "ji 

«Vj 

“  vV  .  ■  j 
>W.n1 


.v.v.V. 

■  v  %•  '.•  •: 

.  %  S  \  «\J 


vvv*w 

5££&: 

■xtaSivi- 


ENHANCED  SURVIVABILITY  FOR  SINGLE 

NETWORKS 


PERCENTAGE  OF  CONNECTIVITY  FOR  NODE  PAIRS 


!£iu 

£  o 


O  2 

LU  UJ 

2  O 
2  CC 

O  °- 


£  < 
l?  Kf  oa 

U-  -J  y  O 

uj  >  o  -J  a 

h*  >  U.  C  i 

a. 

5  </>  fC  Jr  5  & 

8ggS§S 

«3§<«£ 

s£§e85 

3  <C5U3 
^WD.S24 


V 


“-fit 

UJ  o  = 
O  CC  — 
O  uj  H 
2»  Q.  O 

<  i  z 

clO 
5x0 
>  <  u_ 
0  2  0 


CD 
< 
00  g 

6  C 
CL 
_l 

§ 

O  > 

CC 
Z) 
CO 
'T  LU 

o  Q 
O 
2 
Q 
2 
O  < 

2 


ii 


v V 
v.A/v 


■Vr  »o.  O 


«$* 

SM'J 


vv.v-* 

vS- 

vvss 

.  vC % 


.  • .  <v 


.■>  .v 


EXAMPLE  OF  SURVIVABILITY  IMPROVEMENT  RESULTS 


MONITORING  AND  CONTROL  FOR  THE 
WIDEBAND  PACKET  SATELLITE  NETWORK 

Steven  Biumer.tna) 

Manager,  Network  Technology  Dept. 

B8N  Laboratories.  Inc. 

Cambridge,  MA 
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OUTLINE  OF  TALK 


Overview  of  Packet  Satellite  Network  '"ecrnoicgy 
Topology  and  Description  of  the  Wideband  Netwcr* 

Earn  Terminal  and  Satellite  Modem,  Codec  Cr.aracter  st  cs 
Wideband  Network  Monitoring  Data 
Wideband  Network  Control 
Wideband  Network  Fault  Isolation  and  Repair 


PACKET  SATELLITE  NETWORK  TECHNOLOGY 

•  Satellite  channel: 

shared  multi  access  uplink  *  orcaocast  downlm< 


KyStfa 

rVV>' 
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•  Channel  capacity  s  efficiently  demand  assigned  on  a 

packet- by -packet  basis  using  the  PODA  reservation 
protocol 

•  Supports  pure  datagram  service  for  bursty  traffic  and 

connection  oriented  "stream"  service  for  constant 
duty  cycle  real-time  traffic  such  as  sensor  data  and 
packet  voice  and  video 

•  Dynamic  broadcast  group  addressing 

•  Mu'tipie  levels  of  transmission  reliability  via 

variable-rate  PEG  coding 

•  Multiple  levels  of  priority  ‘or  both  datagram  traffic  and 

3*ream  allocations 

•  Pre-empticn  of  lower-priority  stream  allocations  by  "ew 

higher-priority  allocation  recuests 
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PACKET  SATELLITE  NETWORKS 

DARPA  Atlantic  Packet  Satellite  Network  SA*NE~ 

Two  independent  £4kb/s  sharea  oroaccast  enamels 
Operates  on  INTELSAT  Atlantic  Ocean  Major  Path  1 
Uses  BBN  C/30  packet  switch 
Provides  Internet  connectivity  to  ARPANET  ‘or  many 
European  research  groups 

Used  to  support  NATO  C2  mterccerability  experiments. 
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DARPA  Wideband  Packet  Satellite  Network 

3  Mb/s  shared  broadcast  channel 
Operates  on  WESTAR  IV  domestic  satellite 
Uses  BBN  Butterfly  Multiprocessor  packet  switch 
Supports  multimedia  (vcice/videc-tex: grasses: 
conferencing  and  high  speed  comDuter  data 
communication 

Provides  alternative  to  ARPANET  for  long-haul  domestic 
traffic 

NAVELEX  Mobi'e  Access  Terminal  NetworK  MATNET' 

l9.2Kb.s  FLTSATCCM  UHF  shared  broadcast  :-arrei 
Uses  standard  shipboard  antennas.  COMSEC  ec-  ome-: 

and  AN/WSC-3  radios 
Uses  BBN  C.30  packet  switch 
Provides  secure  ship-to-shore  and  ship-to-s-.o  C2 
communication 
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WIDEBAND  NETWORK 
SITE  CONFIGURATION 
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EARTH  TERMINAL  SPECIFICATIONS 

Earth  Terminal  -  Scientific  Atlanta  Model  8C1CC 

•  7  meter,  C-band.  G/T  =  26.0  dB,°K 

•  Receiver:  100°K  Ga  As  FET  Low  Noise  Amplifier 

•  Transmitter:  125W  TWT  High  Power  Amolifier 

•  Single  crystal  up, down  converters 

•  RF  frequencies:  xmt- 6151 .5  MHz  rcv»  3926  5  MHz 


IF  frequency  -  34  MHz 


BURST  MODEM  /  CODEC  SPECIFICATIONS 


Burst  Modem:  M'A-COM  Linkabit  Model  L3M36A 

•  Data  rate:  193,  386,  772,  1544  Ksymbols-'sec 

•  Modulation  types  QPSK  or  BPSK 

•  IF  frequency  range:  52.000  •  87.395  MHz  :n  5KHz  steDS 

•  Eurst-to-burst  frequency  tolerance:  -5C0  Hz  at 

1 .544  Msym/sec 

•  Long  term  input  power  range:  -30d8m  -iCcB 

•  Bursi-to-curst  input  power  range:  *5d3 

•  Can  be  operated  as  stand-alone  'Burst  Test  Modem- 
Codec  M  A-COM  unkaba  Model  LCC36B 

•  Convolutional  Encoder 

•  Sequential  Decoder 

•  Ceding  rates:  1.2.  3/4,  7  3,  1  ' uncodec i 
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NETWORK  OPERATIONS  CENTER  (NOC) 

Located  at  BSN  in  Cambridge.  MA 

Provices  network  monitoring,  control.  ‘ault  isolation, 
and  repair  facilities  for: 

ARPANET 
MILNET  (back  up) 

Internet  Gateways 
SATNET 

Wideband  Network 

Other  commercial  X.25  networks 

Staffed  24  hoursday,  365  days,  year 

Operates  host  computer  facilities  used  for  collecting 
real-time  status,  statistical,  and  exception  cata  ‘ron 
networks,  for  exercising  control  over  the  networks,  and 
for  assistance  in  network  trouble  shooting 

Redundant  monitoring  and  control  paths  are  creviced 
wherever  possible 

Dispatches  and  coordinates  repair  services  ‘or  eased 
phene  lines,  satellite  channel  equipment,  modems, 
hosts,  and  packet-switching  nodes 


WIDEBAND  NETWORK  MONITORING  DATA 

Status  data  •  periodically  transmitted  to  the  NIOC  oy  every 
BSAT: 

•  Hardware  and  software  configuration 

•  Satellite  channel  interface  state  'e.g..  synchronized. 

looped,  etc.) 

•  Site  oarameter  settings 

•  Host  computer  link  state  {e.g.,  up.  cown,  locped.  etc. 

•  Earth  Terminal  and  Modem/Codec  status 


WIDEBAND  NETWORK  MONITORING  DATA 
(CONT'D) 
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Statistical  data  -  periodically  ‘ransmittec  to  the  NCC  oy 
every  BSAT : 

•  Traffic  statistics: 

messages  to/from  hosts 
messages  to/from  channel 
bursts  to/from  channel 

•  Modem/Codec  Test  and  Monitor  Data  ■  each  of  the 

following  is  collected  at  all  BSATs  separately 
for  every  BSAT  heard  on  the  satellite  channel: 
number  of  received  bursts 
frequency  offset 
received  power 
Es/No  estimates 
bits  corrected  by  decoder 
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WIDEBAND  NETWORK  MONITORING  DATA 
(CONT’D) 


Trap  data  -  spontaneously  transmitted  to  the  NCC  dy  a 
BSAT  in  response  to  exceptional  conditions  sucn  as: 


•  Changes  in  BSAT,  Modem/Codec.  Earth  Terminal,  or 

host  link  status 

•  High  satellite  channel  or  host  link  error  rates 

•  BSAT  or  Modem/Codec  throughput  overloads 

•  Satellite  channel  protocol  or  host  protocol 

exceptions 

•  Program  exceptions 
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WIDEBAND  NETWORK  CONTROL 


Remote  control  of  any  BSAT  can  be  exercised  ‘rcm  NCC 
host  computer  facilities  or  from  any  BSAT  consoie. 

Control  messages  sent  to  a  BSAT  modify  the  BSATs 
'external  parameters’.  Actions  that  can  be  oerformed 
via  the  external  parameters  include: 

•  Looping/uniooping  the  satellite  chanrei  interface  at 

various  points  in  the  BSAT,  Modem, Codec,  or 
Earth  Terminal 

•  Looping/unlooping  host  computer  interfaces 

•  Enabling, disabling/resetting  satellite  channel  or 

host  interfaces 

•  Reconfiguring  BSAT  software  to  or;ve  '■ecuncart 1  C 

devices 

•  Invocation  of  built-in  diagnostic  test  crocecures 

•  Generation  of  artificial  test  traffic 

•  BSAT  built-m  bit  error  rate  testing 
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•  UplinK  frequency  adjustment 

•  Modification  of  Modem, Codec  parameters  e.g..  FEC 

coding  rate,  modulation  type,  channel  symbol 
rate) 

•  Modification  of  protocol  parameter 
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Informational  requests 


WIDEBAND  NETWORK  FAULT  ISOLATION  AND 

REPAIR 

•  Fault  isolation  is  performed  by  means  of  NCC  computer 

control  of  the  BSAT  external  parameters  aicrg  with 
inspection  of  the  received  network  monitor  rg  data 

•  Additional  diagnostic  facilities  are  provided  by : 

Burst  Test  Modem 

Remote  monitoring  and  control  of  Earth  Terminal 
status  by  CONTEL  ASC 

•  Long-term  drifts  and/or  degradations  in  satei'ite  charre: 

performance  can  be  detected  via: 

Test  and  Monitor  Data  collection 
Automated  scanning  of  the  satellite  channel  ccwvn* 
received  at  BBN 

Equipment  adjustment  or  replacement  can  oe  mtiated 
before  performance  becomes  unacceptable. 

•  Repairs  and  adjustments  are  dispatched  ‘rcm  5SN. 

Cambridge  as  required 


SUMMARY 


The  DARPA  Wideband  Packet  Satellite  Network  s 
characterized  by: 

•  Widely  distributed  unattended  network  stes 

•  Connectivity  via  a  single  shared  satellite  channel  using 

a  demand-ass.gned  TDMA  protocol 

•  Satellite  enamel  equipment  which  can  drift  m  power  and 

frequency 

•  Satellite  Modem/Ccdec  unit  performance  degradations 

in  the  face  of  large  intersite  power  and  frequency 
differences 


Automated  real-time  network  monitoring,  control,  and  ’auit 
c'agr.  jsis  systems  and  techniques  have  oeen  deveicced  ana 
successfully  applied  resulting  in  the  provision  of  staoie  network 
operations. 


W-MM  374  PROCEEDINGS  OF  THE  CONHUN I  CRT  IONS  NETWORK  MANAGEMENT 
WORKSHOP  <1M7>  HELD.  .  <U)  ItOHE  HI*  DEVELOPMENT  CENTER 
ORIFFISS  HFB  NV  J  J  SRLERNO  ET  HL.  NOV  07 
UNCLASSIFIED  RROC-TR-G7-2J1  F/0  23/4 
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TELECOMMUNICATIONS /  CAPABILITIES 


STRATEGIC  NETWORK  FUNCTIONS 


NETWORK  MANAGFMrNT 
FUNCTIONAL  DFFiNIIION 


Ml  1W0RK  MANAGf  MFNT  SOIIJIION  PROCCSS 


DATA  ME  I  WOK  SAMPLE  SOLUTIONS 


NETVIEW/PC  WITH  NETVIEW  PROVIDES  THE  BA  H S  FOR  CONSTRUCTING  A 
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Network  Characteristics 


Communications 
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Digital  Communications _  Martin  Marietta  Laboratories 


Digital  Communications _ Martin  Marietta  Laboratories 


Communications 


Some  Mathematical  results  (Werner  Furth): 


t  Radio  Routing  Across  Unidirectional 
nks  and  to  Receive  —  Only  Nodes 
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Network  Management  for  SURAN 


Unidirectional  Links 
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that  indicates  some  node  can  hear  them. 
(3)  nodes  then  send  a  source -routed  pkt  to 
nodes  that  can  hear  them  to  establish  link. 


LINK  ESTABLISHMENT  PROTOCOLS 
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ROUTE  ESTABLISHMENT  PROTOCOLS 


FORWARDING  PROTOCOLS 
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FORWARDING  PROTOCOLS 
generally  have  link  acks  (e.g.  ARQ 


TRANSPORT  &  HIGHER  LEVEL  PROTOCOLS 
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TRANSPORT  &  HIGHER  LEVEL  PROTOCOLS 
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TRANSPORT  &  HIGHER  LEVEL  PROTOCOLS 
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preface 

The  material  in  this  paper  vas  presented  in  an  earlier  form  at  the 
Hay  86  SURAN  Implemented  Meeting  and  at  the  Hay  86  Tactical  Internet 
Task  Force.  This  paper  hopefully  clarifies  some  of  the  questions 
and  incorporates  some  of  the  comments  that  arose  at  these  tvo  meetings. 
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1 .  INTRODUCTION 

Often,  either  due  to  failures  or  operational  requirements,  a 
node  vithin  a  netvork  cannot  transnit  any  data.  The  node  can  still 
passively  receive  data,  but  can  no  longer  transmit  data,  acknowledge 
any  data  reception,  or  even  continue  to  participate  in  the  normal 
netvork  routing  protocols-  In  addition,  it  is  more  likely, 
especially  in  a  radio  network,  that  one  node  can  reliably  hear 
another  node,  yet  the  second  node  cannot  hear  the  first.  In  other 
words,  there  can  be  a  unidirectional  link  between  tvo  nodes  instead 
of  a  bidirectional  link. 

This  paper  examines  the  current  DARPA  Packet  P.aoic  Netvork 
(PRNET)  link  connectivity,  tier  routing,  and  packet  forwarding 
protocols  and  describes  how  they  can  be  adapted  to  support 
unidirectional  links  as  well  as  bidirectional  links-  Problems  and 
adaptations  at  the  transport  and  application  protocol  layers  are  also 
examined. 

Any  network  area  that  could  have  unidirectional  links  or 
receive-only  nodes  could  use  the  adapted  netvork  ar.d  transport 
protocols  described  in  this  paper.  Areas  examined  within  this  paper 
are  multi-channel  networks  (internets),  network  reconstitution, 
multi-level  secure  networks,  networks  that  contain  areas  of  dense 
connectivity,  and  netvork  expressways  (backbones). 


2.  TYPES  OF  LINX  CONNECTIVITY 


This  paper  vill  use  the  terminology  from  this  section  for  the 
link  and  network  routing  connectivity. 

There  are  4  types  of  link  connectivity  possible  between  2  nodes, 
say  node  A  and  node  B.  The  4  types  along  vith  the  terminology  used 
within  this  paper  are: 

*  bidirectional  link  between  A  and  B  (bi-link), 

*  unidirectional  link  from  A  to  B  (uni-link), 

*  unidirectional  link  from  B  to  A  (uni-link),  and 

*  no  link  between  A  and  B  (no-link). 

Uni-linkr  can  occur  for  several  reasons.  Packet  Radio  (PR)  can 
have  uni-links  because  PRs  could  be  transmitting  at  different 
transmission  power  levels  or  else  using  antennas  vith  different 
gains.  In  addition,  if  a  PR  network  is  using  frequency  diversity, 
then  the  frequency  channel  from  PR  A  to  PR  B  might  be  temporarily  cut 
off  while  the  channel  from  B  to  A  might  still  be  operational  on 
another  frequency.  In  addition,  PRs  may  for  operational  reasons,  for 
example  to  conserve  power,  may  go  into  a  mode  of  operation  where  they 
would  still  receive  but  would  not  longer  transmit  thus  causing 
uni-links.  Many  conventional  routing  protocols  consider  uni-links  to 
be  equivalent  to  no-links. 

Th  re  are  4  types  of  network  routing  connectivity  possible 
between  2  nodes,  say  node  A  and  node  B.  The  4  types  along  with  the 
terminolcgv  used  within  this  paper  are: 

*  two-way  route  between  A  and  B  (2-way), 

*  one-way  route  from  A  to  B  (1-way), 

*  one-way  route  from  B  to  A  (1-way),  and 

*  no  route  between  A  and  B  (no-way). 

All  1-way  routes  are  caused  by  has  uni-links  but  not  a.l 
uni-links  cause  1-way  routes.  Conventional  transport  protocol 
consider  1-way  routes  to  be  equivalent  to  no-way  routes. 


Figure  1  lists  the  possible  combinations  of  link  and  network  routing 
connectivities  while  Figure  2  shows  an  example  of  each  possible 
combination. 
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3.  ADAPTATION  OF  CURRENT  OARPA  PACKET  RADIO  NETWORK  protocols 

3.1  CURRENT  OARPA  PACKET  RADIO  NETWORK  PROTOCOLS 

The  DARPA  Packet  Radio  Network  (PRNET)  measures  link 
connectivity  and  calculates  routes  in  a  distributed  name:  [JL'SI  86), 
(JUBI  85 ] ,  (VEST  82).  Normally  host  devices  are  attached  to  so*e  of 
the  packet  radios  (PRs),  however  routing  packets  to  devices  is 
omitted  from  this  paper  since  it  is  the  same  as  routing  packets  to 
the  PRs  that  the  devices  are  attached  to.  (Packets  are  routed  to 
devices  by  routing  across  the  PR-NET  to  the  PR  that  the  devices  are 
attached  to.) 

Figure  3  shovs  a  typical  PRNET.  Each  PR  maintains  two  types  of 
network  information: 

*  a  neighbor  table  containing  information  about  the  link  between 
itself  and  the  PRs  that  it  can  directly  receive  from  and 
transmit  to, 

*  a  tier  table  containing  network  routing  information. 

i 

3.1.1  PRNET  LINK  CONNECTIVITY  ALGORITHM 

Each  PR  determines  that  a  link  exists  between  it  and  another  PR 
(called  a  neighboring  PR)  when  it  receives  a  packet.  The  packet 
header's  transmitting  PR  ID  is  used  to  determine  the  neighboring  PR 
ID.  Note  that  due  to  the  broadcast  nature  of  the  PRNET,  PRs  receive 
both  packets  addressed  to  them  and  overheard  packets  addressed  to 
other  PRs.  The  measured  link  quality  from  PR  L  to  its  neighbor  PR  N 
is  the  ratio  of  packets  actually  transmitted  by  ?R  L  to  the  total 
number  of  packets  actually  received  by  PR  M.  This  1 inn  quality  (of 
the  uni-link  from  L  to  H)  is  smoothed  ano  hysteresis  is  applied  to 
determine  its  good/bad  rating.  Periodically  each  PR  transmits  a 
control  packet  that  lists  the  number  of  packets  that  it  has 
transmitted  and  the  receive  link  quality  from  each  of  its  neighboring 
PRs.  For  example,  if  PR  L  transmits  80  packets  in  a  given  period  of 
time  and  PR  M  receives  50  of  them,  then  the  uni-link  quality 
from  PR  L  to  PR  M  is  5/8,  which  is  just  high  enough  for  a  good 
rating.  The  bi-link  to/fror.  PR  L  from/to  PR  M  is  judged  gooc  enough 
to  route  packets  over  when  both  uni-links  PR  L  to  PR  M  and  PS  M 
to  PR  L  are  rated  good. 

3.1.2  PRNET  TIER  ROUTING  ALGORITHM 

The  routing  information  in  the  PRNET  is  maintained  in  a 
distributed  manner  by  each  PR  in  its  tier  table.  There  is  one  tier 
table  entry  per  PR  in  the  network.  Each  entry  contains  the  following 
information: 

*  destination  PR  ID, 

*  ID  of  the  next-PR  (i.e.  neighbor  PR)  that  is  on  the  route  to  the 
destination  PR, 

*  length  of  the  route  to  the  destination  PR  (in  tier  levels),  and 

*  mechanisms  for  determining  if  the  route  is  good  or  bad. 

For  the  network  shown  in  figure  3,  PR  L’s  tier  routing  table  is  shown 
in  figure  A.  The  distance  between  a  PR  and  its  neighboring  ??.s  is 
defined  to  be  1  tier  level  also  called  "1  hop"  in  the  literature. 
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FIGURE  3 

AN  EXAMPLE  PACKET  RADIO  NETVORK  CCNFIG'JRATION 
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PRs  maintain  their  tier  routing  tables  as  follows: 

(1)  A  PR  alvays  puts  Itself  into  its  tier  tabl*  vith  sero  rout* 
length. 

(2)  PRs  periodically  transmit  a  control  packet  containing  each 
destination  PR  vith  its  corresponding  route  distance.  The 
receiving  neighbor  PRs  can  then  use  this  information  to 
update  their  tier  table. 

(3)  PRs  can  also  update  their  tier  tables  from  information  in  the 
routing  Header  portions  of  overheard  data  packets. 

The  goal  of  the  tier  tabl*  is  to  alvays  maintain  the  best 
information  about  hov  to  get  to  destination  PRs.  Currently,  the  best 
rout*  is  defined  to  be  the  shortest  rout*  (in  number  of  tier  levels) 
vith  good  bi-link  connectivity  between  each  PR  on  the  rout*. 

Therefore  the  tier  table  can  be  updated  only  vhen  certain  conditions 
are  met.  The  tier  table  is  updated  vhen  the  received  packet  in  (2) 
or  (3)  above  vas  received  froa  a  neighbor  PR  across  a  good  b;-lir.k 
and  any  one  of  the  following  conditions  is  also  met: 

•  there  is  no  stored  tier  entry  for  that  destination  PR, 

•  the  route  length  plus  one  from  the  received  packet  is 
strictly  less  than  the  stored  route  length  for  that 
destination  PR,  or 

•  the  PR  vhich  transmitted  the  received  packet  is  stored  in 
the  tier  table  as  the  next-PR  in  the  route  for  that 
destination  PR. 

The  update  consists  of  creating  a  new  tier  entry  if  required  and  then 
setting  the  next-PR  in  the  route  equal  to  the  ?R  that  trar.sai  *  ted  the 
received  packet  and  setting  the  route  length  equal  to  the  rout* 
length  plus  one  from  the  received  packet. 

Vhen  the  link  quality  to  a  neighbor  PR  (say  the  li-.k  from  ?? 
to  PS  h)  gees  "bad",  then  all  the  routes  in  PR  Ls  tier  table  which 
shov  ?R  “  as  the  next-??,  in  the  route  are  also  considered  to  be  bad. 
This  signifies  that  PR  M  can  no  longer  provide  a  reliable  vay  frr  PR 
L  to  send  packets  to  the  destination  PR  and  a  nev  next-PR  should  be 
chosen.  Thus,  a  nev  good  rout#  can  be  formed  even  if  it  is  lerger 
than  »he  old  bad  on*.  The  nevs  of  the  bad  tier  Information  is 
distributed  in  the  control  packet  vith  the  good  tier  information. 

This  spreading  of  bad  rout*  information  and  other  mechanisms  break  up 
possible  route  loops  and  ensure  that  obsolete  data  does  not  override 
the  up-to-date  data. 

3.1.3  PR NET  PACKET  POSVAROINC  ALCORITHM 

A  PR  ures  data  from  its  tier  table  to  route  packets  through  the 
network.  Some  PR,  say  PR  l,  originates  a  packet  for  some 
destination,  say  PR  N.  The  source  PR  looks  up  the  destination  entry 
in  the  tier  table  and  copies  She  destination  ?P.  IP  and  next-PR  :n  the 
route  into  the  packet  header.  The  source  PR  then  transmits  the 
packet  to  the  nexs-?R  in  the  route.  The  next-PR  in  t.-.e  route 
receives  the  packet,  determines  that  it  is  not  the  packet's 
destination,  looks  up  the  destination  entry  in  its  tier  table,  copies 
the  next-PR  in  the  route  into  the  header,  and  transmits  the  packet  on 
to  its  next-PR  in  the  rout*.  This  process  continues  until  the  packet 
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reaches  the  destination  PR.  Figure  5  shcvs  the  forvardir.g  of  a 
packet  from  PR  L  to  PR  N.  Mechanises  exist  to  stop  packets  from 
looping  and  detect  packet  duplicates. 

PRs  continue  to  retransmit  a  packet  either  until  they  hear  an 
acknowledgement  from  the  next-PR  in  the  route  or  until  they  have 
transmitted  the  packet  a  predetermined  number  of  times.  The 
acknowledgement  normally  consists  of  overhearing  the  next-PR 
forwarding  the  packet  on.  For  example,  in  figure  5.  PR  L  overhears 
PR  M  transmit  the  packet  to  N.  This  overhead  packet  is  an 
acknowledgement.  For  special  cases,  such  as  when  the  packet  reaches 
the  destination,  a  specific  acknowledgement  is  transmitted  back.  For 
example,  in  figure  5,  PR  S  transmits  a  specific  acknowledgment  back 
to  PR  H. 

If  a  PR  does  not  receive  an  acknowledgment  within  a  certain 
number  of  transmissions,  then  it  starts  asking  for  help  in  finding  an 
alternate  route  to  the  destination  PR.  Thus,  in  figure  3,  if  PR  L 
does  not  receive  an  acknowledgment  from  PR  M  within  three 
transmissions,  then  PR  L  asks  for  alternate  routing  help  and  PR  R 
would  help  route  the  packet  on  to  PR  N.  Mechanisms  exist  to  stop 
packets  from  looping  forever  around  the  network  via  this  alternate 
routing  help  and  also  to  damp  out  packets  traveling  to  the 
destination  along  multiple  routes  (i.e.  the  route  PR  L  to  PR  M  to  PR 
N  and  the  route  PR  L  to  PR  R  to  PR  P  to  PR  N). 

3.2  CHANCES  TO  SUPPORT  UNIDIRECTIONAL  LINKS  VITHIN  THE  RR.NET 

Changes  must  be  made  in  the  link  connectivity,  tier  routing,  and 
pacxe:  forwarding  algorithms  to  support  unidirectional  links. 
Currently  the  PRs  will  only  use  bi-links  for  routing  purposes.  This 
section  shows  how  to  use  uni-links. 

3.2.1  CHANGES  TO  PR.NET  LINK  CONNECTIVITY  ALGORITHMS 

This  section  describes  4  methods  of  determining  when  a  good 
uni-link  exists  between  two  RRs.  Examples  reference  figure  3  where 
PR  M  is  in  a  receive-only  mode  of  operation  and  all  of  the  other  PRs 
are  in  a  normal  receive  and  transmit  mode  of  operation. 

3.2. 1.1  LINK  CHANGE  1 

The  change  to  the  PRNET  link  connectivity  algorithms  suggested 
in  this  section  would  work  for  a  PR  that  established  normal  bi-link 
with  its  neighbors  and  then  changed  to  uni-links  with  its  neig.mfcors 
and  with  either  2-way  or  1-way  network  routing  connectivity. 

A  PR  could  come  up  and  participate  in  the  normal  PRNET  link 
connectivity  algorithms  until  it  has  good  bi-links  with  some  number 
of  PRs.  Them  this  PR  would  tell  some  or  all  of  its  neighbor  PRs  that 
it  is  abcut  to  change  to  receive-only  mode.  These  neignbor  PRs  would 
then  freeze  their  good  uni-link  qualities  to  the  receive-only  PR 
until  some  future  time.  This  future  time  could  be  quite  far  off  if 
the  radio  connectivity  is  not  expected  to  change,  as  for  example, 
when  the  receive-only  PR  and  its  chosen  set  of  neigmhrro  ar«  mot 
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mobile.  If  the  receive-only  PR  expects  to  be  mobile,  then  it  could 
tell  its  neighbor  PRs  how  long  it  expects  to  stay  in  connectivity 
before  the  uni-link  quality  goes  bad.  Also,  if  a  neighbor  PR  moves, 
it  would  set  its  uni-link  quality  to  bad.  For  example.  PR  H  could 
tell  PR  L  and  PR  N  that  it  is  about  to  go  to  reeeive-onlv  mode.  PR  L 
and  PR  N  would  then  freeze  their  uni-link  quality  to  PP  K  at  a  good 
rating.  Since  PR  R  was  not  notified,  it  would  continue  to  use  the 
normal  link  algorithm  and  conclude  that  PR  M  is  no  longer  a  neighbor 
PR. 

3.2. 1.2  LINK  CHANGE  2 

The  change  to  the  PRNET  link  connectivity  algorithms  suggested 
in  this  section  would  work  for  a  PR  that  has  uni-links  with  its 
neighbors. 

Suppose  that  a  control  center  exists  in  the  network  capable  of 
predicting  the  radio  connectivity  of  the  network  by  knowing  the 
position  of  all  the  PRs  in  the  network  along  with  terrain  data  for 
the  geographic  area.  Then  the  control  center  could  tell  sere  PR  that 
it  has  a  good  uni-link  to  a  neighboring  receive-only  PR.  For 
example,  a  control  center  could  tell  PR  L  that  It  has  a  good  unl-llnk 
to  PP.  M.  Then  PS  L  would  consider  PR  M  to  be  a  neighbor  PS  and  set 
its  uni-lir.k  to  PR  M  at  a  good  rating. 

3. 2. 1.3  LINK  CHANGE  3 

The  change  to  the  PRNET  link  connectivity  algorithms  suggested  in 
this  section  would  work  for  a  PR  that  has  uni-links  with  its 
neighbors  ar.d  also  (in  one  sense)  has  only  a  l-way  network  route  to 
its  neighbors  (and  in  an  external  sense  has  some  sort  of  2-vay 
network  route.) 

Suppose  that  there  exists  some  communication  channel  external  to 
the  PRNET,  for  example  Meteor  Burst  (GEOR  84|.  Then  the  receive-only 
PP.s  could  have  some  other  means  of  communicating  with  the  control 
center.  The  receive-only  PR  could  determine  that  it  has  a  good 
receive  uni-link  from  some  neighbor  PR  and  relay  this  information  to 
the  control  center.  The  control  center  would  then  relay  this 
information  on  to  the  neighbor  PR.  For  example,  if  PR  M  determines 
that  it  has  a  good  receive  uni-link  from  PR  L  and  PR  N.  then  PR  M 
would  relay  this  information  to  the  control  center  and  the  control 
center  would  then  relay  this  information  on  to  PR  L  and  PR  N.  PR  L 
and  PR  N  vould  then  store  the  fact  that  they  have  a  good  transmit 
uni-link  to  PR  M. 

3.2. 1.4  LINK  CHANGE  4 

The  change  to  the  PRNET  link  connectivity  algorithms  suggested  in 
this  section  vould  work  for  a  PR  that  has  uni-links  with  its 
neighbors  and  also  has  2-way  network  routes. 

It  is  possible  that  some  PRs  could  be  in  such  a  network 
environment  (possibly  due  to  transmission  power  imbalances)  that  one 
PR  could  hear  another  PR  yet  the  converse  is  not  true.  Thus,  there 
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is  an  uni-link  froa  the  first  PR  to  the  second.  If  there  still 
exists  some  other  path  betveen  the  two  PRs,  then  packets  could  still 
be  routed  froa  the  second  PR  to  the  first  PR.  A  distributed 
algorithm  has  already  been  published  that  describes  hov  to  spread 
uni-link  connectivity  inforaation  within  such  a  network  (GERL  83|, 
although  the  algorithm  would  have  to  be  modified  slightly  to  account 
for  the  broadcast  nature  of  packet  radio. 

3.2.2  CHANGES  TO  PRNET  TIER  POUTING  ALGORITHMS 

The  current  tier  routing  algorithms  would  work  in  a  network  with 
uni-lir.ks  with  only  minor  changes.  First,  the  definition  of  the  tier 
route  must  change  from  waning  the  best  route  with  good  bi-link 
connectivity  between  each  PR  on  the  route  to  aeaning  the  best  route 
with  good  ur.i-link  connectivity  toward  the  destination  PR.  Best 
route  could  either  still  imply  shortest  route  virhout  regard  to 
whether  the  links  are  bi-link  or  uni-link,  or  it  could  be  a  function 
of  route  length  ar.d  number  of  uni-links.  For  example,  bi-links  could 
have  a  weight  of  one  and  uni-links  could  have  a  weight  of  3.  Thus  the 
best  route  vould  be  the  route  with  the  smallest  total  weight.  Tier 
routing  information  would  still  be  updated  as  before,  except  that  now 
the  link  to  the  next-PR  in  the  route  would  only  have  to  be  a  good 
uni-link  instead  of  a  good  bi-link. 

3. 2. 2.1  TIER  CHANGE  1 

The  change  to  the  PRNET  tier  routing  algorithms  suggested  in 
this  section  would  work  for  a  PRNET  that  has  all  bi-links  except  for 
uni-links  to  PRs  that  have  only  1-way  network  routes,  i.e.  except  for 
PRs  that  are  in  a  receive-only  node  of  operation. 

This  section  assumes  that  one  of  the  PRNET  link  connectivity 
changes  1-3  has  been  implemented.  Thus  the  neighbors  mat  nave  good 
transmit  ur.i-links  to  the  receive-only  PR  vould  list  tr.e  receive-of.ly 
PR  as  tier  data  at  a  distance  of  1  tier  level.  Tier  tables  would 
then  continue  to  get  updated  as  before  using  the  PROP  mechanism. 

3. 2. 2. 2  TIER  CHANGE  2 

The  change  to  the  PRNET  tier  routing  algorithms  suggested  in 
this  section  would  work  for  a  PRNET  that  has  all  uni-lmks  or 
bi-links  as  long  as  all  of  the  PRs  have  2-vay  network  routes. 

This  section  assumes  that  the  PRNET  link  connectivity  change  4 
has  been  implemented.  Thus  the  neighbors  that  have  good  transmit 
uni-links  to  the  receive-only  PR  would  list  the  receive-only  PR  ss 
tier  data  at  a  distance  of  1  tier  level.  A  distributed  algorithm  has 
already  been  published  that  describes  how  to  spread  tier  routing 
information  around  a  network  with  uni-links  |GERL  831  although  this 
although  this  algorithm  does  not  work  for  a  network  with  receive-only 
nodes.  (Note  however,  that  tier  change  1  could  be  incorporated  into 
this  change  so  that  PRs  that  keep  a  receive-only  node  permanently 
within  their  neighbor  table  vould  also  keep  this  receive-only 
permanently  in  their  tier  table  as  well.) 


3.2.3  CHANGES  TO  PRNET  PACKET  FORVARDING  ALGORITHMS 


PRs  vould  continue  to  forward  packets  by  using  the  tier  table  to 
look  up  the  next-PR  in  the  route.  However.  since  the  forvarding  PR 
could  not  receive  an  acknowledgment  back  across  a  uni-link,  the 
forvarding  PR  would  have  to  transmit  the  packet  a  number  of  times, 
possibly  a  function  of  the  (predicted)  uni-lir.k  quality.  jn 
addition,  the  forwarding  PR  vould  no  longer  request  alternate  routing 
help  when  acknowledgments  are  not  heard. 

3. 2. 3.1  FORVARDING  CHANGE  1 

Adaptive  Forward  Error  Correction  (FEC)  is  being  designed  for 
the  current  bi-link  forvarding  protocols.  The  proposed 
adaptive  FEC  algorithms  could  be  modified  so  that  packets  are 
transmitted  across  a  uni-link  using  a  strong  FEC  rate. 

3. 2. 3- 2  FORVARDING  CHANGE  2 

If  there  are  several  PRs  vith  uni-links  to  the  sa-'e  receive-only 
PR,  i.e.  a  PS  that  has  only  1-vay  netvork  routes  tovard  it,  then  the 
probability  of  getting  a  packet  to  this  receive-only  PR  vould  be 
improved  if  more  of  these  neighboring  PRs  vere  to  transmit  the 
packet.  Thus,  each  neighboring  PS  should  know  which  other  PSs  also 
have  uni-links  to  the  same  receive-only  PS.  This  scheme  vould  vork 
as  follovs: 

(1)  A  packet  is  forvarded  to  the  receive-only  destination  until  it 
reaches  a  neighboring  PR  to  the  receive-only  node. 

(2)  This  neighboring  PR  then  transmits  the  packet  tovard  the 
receive-only  destination  and  also  sends  a  copy  of  the  packet 
(vith  a  flag  set  to  indicate  that  no  other  copies  should  be 
made)  to  the  other  neighboring  PRs. 

(3)  Vhen  a  copy  of  the  packet  ceaches  another  r.eigr.bor ing  ??,  the 
packet  is  transmitted  tovard  the  destination  PR. 

Thus,  the  probability  is  increased  that  the  receive-only  ?S  will 
receive  the  packet. 
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4.  PROBLEMS  WITH  ENO-TO-END  ACKS  AND  SOME  SOLUTIONS 

Problems  exist  at  the  transport  layer  within  the  OSI  Model  (2IMM 
80]  when  there  is  no  way  for  an  end-to-end  (ETE)  acknowledgment  to  (o 
from  the  destination  back  to  the  source.  Probably  the  worst  of  these 
problems  is  providing  a  reliable  delivery  of  packets.  This  problem 
does  not  automatically  occur  just  because  a  network  has  uni-links, 
instead  this  problem  occurs  whenever  there  is  one  node  that  can  send 
packets  to  another  node  in  the  network  yet  the  second  node  cannot 
send  any  back.  i.e.  a  node  only  has  1-way  network  routes.  This 
problem  car.  occur  whenever  the  destination  of  a  packet  is  in  a 
receive-only  mode  or  a  network  is  partitioned  into  subnets  so  that 
there  exist  only  one-way  uni-links  from  one  subnet  to  the  other 
subnet(s).  Some  solutions  to  this  problem  are  described  below. 

4.1.  ETE  ACK  CHANGE  1 

If  a  receive-only  node  could  occasionally  go  from  having  1-wav 
network  routes  to  having  2-way  network  routes  and  then  go  back  to 
having  1-vay  network  routes,  then  some  transport  application 
protocols  could  be  modified  to  tolerate  this  occasional  feedback. 

The  transport  and  application  protocols  should  require  neither 
lengthy  handshaking  to  open  a  connection  nor  connection  keep  alive 
packets.  In  addition,  the  protocols  should  be  able  to  transmit 
packets  for  a  long  time  before  getting  any  acknowledgment  indication. 
The  receive-only  node  would  store  up  the  acknowledgments  or 
non-acknowledgments  until  it  gets  a  whole  packet  full  or  until  some 
long  period  of  lime  has  elapsed,  1/2  hour  for  example,  before 
transmitting  the  stored  up  acknowledgment  information  back  to  the 
source.  While  this  scheme  could  be  used  to  support  file  transport, 
it  ob  viously  does  not  support  applications  such  as  interactive 
computer  terminals. 

4.:  i~l  aCK  CHANCE  2 

Some  method  of  message  store  and  forward  could  be  implemented  if 
a  receive-only  node  were  to  repeat  a  pattern  of  going  from  1-way 
network  routes  to  2-way  network  routes  jNGUY  86).  For  example.  PS  L 
could  act  as  a  message  store  and  forward  server  for  PS  M  which  is  in 
receive-only  mode.  The  other  PRs  would  route  their  packets  for  ??  M 
to  PR  L.  When  PR  L  received  a  packet  for  PR  M .  it  would  forward  the 
packet  on  to  PR  M  as  an  unreliable  datagram,  store  the  packet  in  its 
memory,  and  provides  the  needed  ETE  acknowledgment  back  to  the 
source.  Vhen  PR  M  goes  back  to  normal  mode  of  operation,  it  would 
then  request  ?P.  L  to  send  it  the  packets  that  it  had  not  received. 
Note  that  this  message  store  and  forward  scheme  asks  quite  a  lot  of  a 
packet  switch,  and  probably  requires  special  hardware  such  as  disk 
storage. 

This  message  store  and  forward  scheme  is  similar  to  the 
time-staged  delivery  networks  for  mail  implemented  by  I3M  and  Tandem 
Computers  IEDVa  86).  IBM’s  implementation  is  called  Systems  Network 
Architecture  Delivery  Systems  (SNAOS)  and  has  been  implemented  in 
IBM’s  Distributed  Office  Support  System  (DISOSS).  Tancem’s 
implementation  is  called  Transfer  and  is  part  of  Tandem's 
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electronic-mail  and  facsimile  transport  products. 

4.3  ETE  ACK  CHANGE  3 

If  no  feedback  to  the  transport  or  application  protocol  layers 
can  be  obtained  from  a  receive-only  node  vith  1-way  routes,  then  a 
probabilistic  retransmission  scheme  could  be  used.  This  scheme 
assumes  that  the  probability  of  the  receive-only  node  receiving  a 
single  datagram  is  known  or  could  be  predicted.  For  example,  if 
there  is  a  50  X  probability  that  the  receive-only  node  will  receive  a 
single  datagram  and  a  packet  is  to  be  delivered  to  the  receive-only 
node  with  99.5  X  reliability,  then  the  packet  would  be  retransmitted 
8  times.  This  probabilistic  retransmission  scheme  could  be 
implemented  either  at  the  application,  transport,  or  link  layer. 

(1)  Implementing  the  scheme  at  the  transport  layer  requires 
knowing  or  predicting  both  the  uni-link  quality  to  the 
receive-only  node  and  the  probability  that  the  datagram  will 
be  delivered  from  the  source  to  the  neighbor  of  the 
receive-only  node.  The  source  application  layer  would 

then  retransmit  the  packet  the  required  number  of  times. 

(2)  Implementing  the  scheme  at  the  link  layer  requires  only 
knowledge  of  the  uni-link  quality,  but  violates  layering. 

The  application  layer  at  the  source  PR  would  reliably 
deliver  the  packet  to  the  application  layer  of  the  neighbor 
PR  using  some  established  transport  protocol  that  relies  on 
ETE  acks.  Then  the  neighbor  PR  would  transmit  the  packet 
the  required  number  of  times  to  obtain  the  desired 
probabilistic  reliability. 

4.4  ETE  ACK  CHANGE  4 

Transport  level  FEC  could  be  used  when  the  data  that  :s  to  be 
sent  to  the  receive-only  node  with  1-way  network  routes  is  so  large 
that  it  must  be  fragmented  into  multiple  packets.  The  data  could  be 
interleaved  over  the  multiple  packets  ar.d  some  form  of  FEC  applied  so 
that  the  receive-only  node  could  still  de-code  the  data  ever,  if  it 
lost  a  packet  or  two  of  the  message. 
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5.  RELATED  AREAS 


5.1  MULTI-CHANNEL  (INTERNET)  OPFRATION 

A  multi-ehar.nel  network  is  made  up  of  nodes  that  are  connected 
via  multiple  types  of  channels.  An  example  of  a  multi -channel 
network  is  an  internet  made  up  of  several  subnets  using  different 
types  of  channels.  In  other  wojds  the  mui t  i -channel  network  is  the 
concatenation  of  several  subnets  using  incompatible  charnels. 
Normally,  subnets  are  assumed  to  be  interconnected  by  bi-links, 
hovever  subnets  could  be  interconnected  by  uni-links  as  veil. 

Interconnecting  a  multiple  access  channel  subnet  to  another 
subnet  could  be  cost  effective  using  receive-only  nodes.  For 
example,  figure  6  shows  an  internet  consisting  of  a  PP.NET  and  a 
SINCGARS  (SINgie  Channel  Cround/Air  Radio  Systems!  .network.  The  two 
subnets  could  be  connected  only  by  uni-links,  yet  there  are  2-vay 
network  routes,  the  transport  and  above  layers  would  r.ot  need  tc  be 
modified.  The  link  and  network  routing  protocols  would  have  to  be 
modified  as  described  above.  If  the  cost  of  building  nodes  that 
could  receive-only  is  less  than  half  the  cost  of  building  nodes  that 
can  both  transmit  and  receive,  then  the  same  amount  of 
interconnection  (i.e.  number  of  links  between  the  two  subnets)  could 
be  realised  for  less  total  cost  using  receive-only  nodes. 

In  addition,  there  ara  some  internets  where  most  of  the  data 
flows  from  one  subnet  to  the  other.  These  subnets  could  be  connected 

by  some  nu-ber  of  bi-links  and  some  number  of  uni-links  to  handle  the 

excess  o.  cata  flowing  from  one  subnet  into  the  other.  Figure  7 
shows  an  example  remote  sensor  network  where  most  of  the  data  flows 
in  from  the  remote  sensors  to  processing  centers.  Thus,  mere  need 
to  be  more  links  to  allow  data  to  flow  into  the  LAN  from  the  PRNET 
than  there  are  to  allow  data  to  flow  from  the  LAN  into  the  PRNET. 

The  use  ;  :  ??.s  that  can  receive-only  could  be  a  cos:  effective  way  of 

provide;  g  these  extra  uni-links  from  the  PRNET  to  the  LAN.  In 
addition,  by  adding  PR  h  to  the  PRNET.  the  data  from  PR  L  ar.d  PR  R 
could  arrive  at  the  LAN  ir,  a  more  timely  fashion  since  there  would  be 
less  PRs  in  the  path  to  add  forwarding  delays.  Note  that  2-way 
network  routes  are  needed  to  go  from  the  LAN  to  the  PRNET  to  provide 
feedback  to  the  PRNET  about  the  link  connectivity  and  tier  routing, 
and  possibly  to  allow  control  commands  to  go  from  the  processing 
centers  to  the  remote  sensors. 

5.2  RECCNSTI'TITION  OF  NETVORXS 

Networks  are  often  required  to  reliably  deliver  packets,  even  in 
the  face  of  failure  of  a  network's  resources.  Network  reconstitution 
is  the  act  of  restoring  partial  network  capability  following  some 
failure:  especially  failures  that  partition  the  network  into 
separate  subnets. 

The  failure  of  »  network's  resources  means  failure  of  either  a 
network  node  or  link.  Note  that  -odes  or  links  can  have  partial  or 
complete  ta  *  a  ig  I  C4  «  Unfortunately  for  many  current  networks  such  as 
the  PRNET  and  the  ARPA.-.et,  the  remaining  functionality  of  partially 
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failed  nodes  or  links  cannot  be  used.  For  example,  if  a  PR  fails  so 
that  it  can  only  transmit  or  receive  instead  of  being  able  to  both 
transmit  and  receive,  then  it  can  no  longer  participate  in  the  PRNET. 
Similarly  links  that  are  damaged  so  that  they  are  nov  only  uni-links 
instead  of  bi-links  can  no  longer  be  used  vithin  the  AFP Ar.et.  If  the 
PRNET  and  the  Ait PA.net  supported  uni-links,  then  the  networks  vould 
automatically  be  able  to  reconstitute  ther.sel.es  and  use  their 
partially  failed  links  and  nodes.  Further  reconstitution  ability  is 
provided  if  the  networks  could  use  1-vay  network  routes  as  well. 

Experiments  have  been  performed  using  the  PRNS7  and  the  AFPA.net 
to  simulate  linking  together  partitioned  islands  of  communications 
[DesB  84].  These  experiments  have  used  the  flexibility  cf  the  Pr.NET 
protocols  to  adjust  to  changes  in  network  connectivity.  Thus  the 
PRNET  can  detect  partially  and  completely  failed  nodes  and  modify  the 
tier  routes  to  go  around  these  failed  nodes.  Modifying  the  PP-NET 
protocols  to  support  uni-links  would  add  robustness  and  allow 
partially  failed  nodes  to  still  aid  in  routing  packets. 

In  addition,  the  use  of  inexpensive  receive-only  ?■;  could  be 
used  as  backups  for  normal  PSs.  For  example,  suppose  that  the  PP.NET 
is  attached  to  the  AJtPAnet  via  several  gateways.  Now  let  cr.e  of  the 
PRs  that  is  connected  to  the  gateway  have  a  complete  failure.  The 
failed  ?K  could  be  quickly  pulled  out  and  a  receive-only  PR  could 
quickly  be  inserted  to  at  least  allow  data  to  flow  from  the  PP.NET  to 
the  AFFAnet.  The  receive-only  PR  would  let  the  PR.NET  know  that  about 
its  uni-li.nk(s)  by  sending  control  packets  to  the  PRNET  via  an 
existing  2-vay  network  route  via  one  of  the  existing  gateways  between 
the  PRNET  and  the  ARPAnet. 

5.3  MULTI-LEVEL  SECURE  NETVORKS 

Multi-level  secure  networks  have  special  problems  when 
implementing  a  Trusted  Computing  Base  (7C3)  (CSC  33).  The  ‘-property 
(st3r  property)  of  the  Bell-La?adula  security  model  means  ’ha:  a 
lover  classified  process  can  send  data  to  a  higher  or  equal 
classified  process  but  that  a  higher  classified  process  car.no:  send 
data  to  a  lower  classified  process  (5UMM  84 | .  Thus  process  A 
(operating  at  Secret)  on  host  l  could  transmit  packets  to  process  3 
(operating  at  Top  Secret)  on  host  2,  however  process  3  cannot 
acknowledge  the  packet  since  the  acknowledgement  could  be  used  as  an 
illegal  data  path,  allowing  the  potential  transfer  of  sensitive 
information  from  a  higher  to  a  lower  level  ( VALX  35).  Process  3  on 
Host  2  then  appears  to  be  a  receive-only  node  to  process  A  on  Host  1. 
One  possible  solution  could  be  to  use  the  transport  protocol  layer 
changes  described  above. 

A  solution  to  this  problem  has  been  published  [«AJ(  35).  F:r 
example,  process  A  described  above  could  transmit  packets  reliably  to 
a  process  B'  (operating  at  Secret)  on  host  2,  and  process  S'  could 
transmit  the  packet  on  to  process  B  (operating  at  Top  Secret)  witn 
high  reliability  without  requiring  any  acknowledgment  since  processes 
B  and  B'  reside  in  the  same  host  computer.  This  lack  of 
acknowledgment  from  process  3’  to  process  B  is  equivalent  to  the 
transport  layer  performing  a  system  call  to  send  a  message  to  an 
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application  layer  without  requiting  »n  acknowledgment  back  from  the 
application  layer. 


Although  the  published  solution  satisfies  common  transport 
protocols,  occasions  could  exist  where  processes  might  want  to  use 
transport  protocols  t.na;  support  a  receive-oaly  mode.  If  other 
words,  there  may  be  times  wr.en  process  A  on  host  1  does  .not  want  any 
secret  process  on  host  2  to  be  able  to  reai  the  .message.  For 
example,  suppose  that  Tom  (who  can  log  onto  host  1  at  Secret)  wants 
to  send  a  critical  message  about  Dick  {who  can  log  onto  host  2  at 
Secret)  to  Harry,  Dick's  supervisor  (who  can  log  onto  host  2  at  Top 
Secret).  Since  Tom  wants  to  make  sure  that  Dick  cannot  read  this 
critical  message,  Tom  would  want  to  send  the  message  directly  to 
Harry,  without  ever  letting  the  message  be  stored  at  a  level  that 
Dick  could  access  Sending  Tom's  message  directly  to  Harry  would  be 
equivalent  to  sending  the  message  to  a  receive-only  mode. 

5.4  NET.'CRaS  THAT  CONTAIN  AREAS  OF  DENSE  CONNECTIVITY 

A  problem  with  broadcast  radio  networks  is  adjusting  the  radio 
transmit  power  control  so  that  an  optimum  amount  of  nodal 
connectivity  is  achieved.  This  is  not  a  problem  for  uniformly 
distributed  nodes,  however,  networks  in  the  real  world  usually  have 
areas  with  dense  nodal  connectivity  and  areas  with  sparse  nodal 
connectivity.  Networks  characterized  by  large  nocal  connectivity 
have  high  levels  of  interference  and  low  throughput  (KLEI  78J. 

The  :u. rant  PRNET  protocol  has  each  PR  transmit  with  the  same 
default  constant  power  level.  Changes  have  been  proposed  so  that  the 
transmit  power  level  would  still  be  the  sa-e  at  etch  PR  i.n  the  PP.NET, 
although  this  PP.NET  vide  transmit  power  level  could  be  changed  as  the 
PP.NET  is  running.  Although  a  decrease  in  transmit  power  reduces  the 
high  -.  \y  in  dense  areas  of  the  retvork,  the  same  decrease  in 

transv.:  power  v:  thin  the  sparse  areas  of  the  network  might  isolate 
seme  nooes  from  th»  rest  of  the  network.  A  better  solution  would  be 
to  decrease  the  transmit  power  level  in  the  dense  areas  of  the 
network  while  leaving  it  alone  or  increasing  it  in  che  sparse  areas 
of  the  network.  However,  now  that  there  are  nodes  transmitting  with 
different  power  levels,  the  links  between  nodes  would  no  longer  be 
symmetrical  and  there  would  be  some  uni-links.  Modifying  the  FR.NET 
proto-ols  as  descried  in  this  paper  would  let  the  PRNET  utilise 
these  -esultant  uni-links,  unless  there  were  no  paths  in  the  reverse 
direction. 

Changes  have  been  proposed  for  dense  net ghborhoods  so  that  the 
power  level  is  not  reduced  but  rather  a  PP.  viil  only  keep  a  limited 
logical  neighoo-hood  l MILL  86 | .  This  change  solves  the  problem  of  a 
limited  memory  in  PPs  in  vnioh  to  store  neighbor  PR  information.  The 
change  however  can  cause  logical  uni-1  inks  to  occur.  Thus  although, 
the  PR  forwarding  algorithms  would  not  have  to  change,  the  PR  tier 
routing  algorithms  would  ha-e  to  change  as  described  in  this  paper. 

5.5  NETWORK  EXPRESSWAYS  (5ACK30NES) 

Vhen  more  and  more  node,  are  added  to  networks,  the  average 
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number  of  nodes  that  packets  have  to  travel  through  from  source  to 
destination  increases.  Normally  this  increases  the  average 
forvarding  delay  of  packets  and  lovers  the  average  throughput. 
Broadcast  radio  netvorks  such  as  PRNET  could  increase  the  transmit 
power  level  of  each  PR  so  that  they  can  be  heard  for  a  longer 
distance.  Unfortunately,  this  increases  the  average  connectivity  in 
the  network  which  increases  the  interference  and  lowers  the 
throughput . 

Network  expressways  or  backbones  are  another  solution  to  this 
problem.  The  network  expressway  vould  be  made  up  of  a  few  PRs  that 
transmit  at  a  high  power  level  and  thus  could  be  heard  for  a  long 
distance.  The  rest  of  the  PRNET  would  transmit  at  a  much  lover  power 
level  and  thus  could  not  be  heard  as  far  away.  Each  PR  that  is  part 
of  the  expressway  would  have  a  neighborhood  of  PRs  transmitting  at 
lower  power  that  could  hear  it  although  they  could  not  be  heard. 

Thus  there  would  be  a  uni-link  from  the  expressway  PRs  to  their 
neighborhood  PRs.  Reference  figure  8.  PR  S  in  PR  A’s  neighborhood 
wants  to  transmit  a  packet  to  PP.  D  in  PR  B's  neighborhood.  PS  S 
transmits  the  packet  to  PR  J  which  transmits  the  packet  to  ?S  A.  PR 
A  then  transmits  the  packet  to  PR  B  and  PR  B  transmits  the  packet  to 
PR  D.  If  the  expressvay  did  not  exist,  then  the  packet  vould  have 
gone  through  many  more  PRs  and  thus  there  would  have  been  a  larger 
delay. 
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RESEARCH  GOALS 


Identify  problems  in  network  management 
appropriate  for  application  of 
artificial  intelligence  technioues 

W  L 

Increase  our  understanding  of 

fundamental  problems  which  arise  in 
the  design  of  intelligent  systems 
distributed  over  a  network 

Develop  new  techniques  for  achieving 
cooperation  among  intelligent 
s>  stems  and  demonstrate  their 
application  to  real  world  problems 
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DOMAIN  CHARACTERISTICS 


Nodes  are  geographically  distributed 

No  node  has  accurate  and  complete 
knowledge  about  global  svstem  state 

w  w  » 

Nodes  have  limited  bandwidth  for 
communication  with  one  another 

No  central  locus  of  control  is  assumed 
(for  surviv abliltv  > 
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TASKS  IN 

NETWORK  MANAGEMENT 


STATUS  ASSESSMENT  -  determine,  at  a 
hiah  level,  network  status  and 
impact  of  events 

FAULT  ISOLATION  -  when  trouble  occurs, 
determine  its  specific  cause 

SER\  ICE  RESTORAL  -  determine  plans 
for  restoring  service  to  as  many 
critical  users  as  possible 


PROBLEM  SOLVING 
REQUIREMENTS 


Performance  assessment  -  (PA) 
data  interpretation 
situation  assessment 

INPUTS: 

equipment  alarms 
traffic  data 

transmission  monitors 
user  complaints 

OUTPUTS: 

system  and  network  status 
failure  detection  and  its  impact 
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University 


PROBLEM  SOLVING 
REQUIREMENTS 

Fault  isolation  -  (FI) 
diagnostic  activity 

identify  location  and  cause  of  failure 
degradation,  or  intermittent  outages 

INPUTS: 

failure  indication  and  probable 
location  (from  PA) 
equipment  alarms 
circuit,  trunk,  link  status 
additional  test  results,  as  needed 

OUTPUTS: 

location  (at  equipment  level  >  of 
failure,  if  known 

oi 

request  for  additional  tests  to 
resolve  ambiguities 


PROBLEM  SOLVING 
REQUIREMENTS 


Service  restoral  -  (SR) 

generate  and  select  plans  j 

for  allocation  of  scarce  resources  j 

to  restore  service  to  disrupted  users  I 

i 

INPUTS:  j 

I 

requests  for  restoral  action  (from  PA)  ! 
circuit,  trunk,  and  link  status 
system  configuration  and  topology  ! 

! 

OUTPUTS: 

set  of  feasible  restoral  plans, 
indicating  circuits  to  be  restored  ! 

(and  those  that  can  not  be),  and  | 

equipment  re-allocations  needed  1 

to  accomplish  these  plans  j 
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ROLE  OF  A  DISTRIBUTED  ! 

NETWORK  MANAGEMENT  SYSTEM  ! 


As  an  operator  aid  - 

reduce  the  "data  overload"  problem 

recommend  restoral  and 
diasnostic  actions 


reduce  the  training  period 


As  a  distributed  controller  - 
enhance  survivabilitv  bv  eliminating 

*  *  w 

dependence  on  a  single  control  node 

provide  coordination  and  cooperation 
among  distinct  control  center^ 

perform  satisfactorily  in  the 
event  of  missing  or  erroneous  data 


RATIONALE 


Highly  complex  problems 

Need  for  a  "good"  solution  within  a 
reasonable  time 

Insufficient  time  for  finding  an  optimal 
solution,  if  it  exists 

Observed  data  and  (non-local)  knowledge 
may  be  errorful  and  uncertain 

Human  experts  are  available  for  some 
problems  and  have  significant  insight 
based  on  many  past  years  of  experience 
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DISTRIBUTED  CONTROL 
SYSTEM  ARCHITECTURE 


Geographic  distribution 

observed  data 
control  points 

localized  knowledge  of  configuration 
and  status 

Functional  distribution 

performance  assessment  iP.-U 
fault  isolation  (FI) 
service  restoral  (SRi 

"Pure’’  distributed  control,  with 
no  locus  of  control  activity  and 
no  locus  of  decision  making  is 
required  to  reduce  vulnerability 
and  enhance  survivabilitv. 
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A  DISTRIBUTED  KNOWLEDGE  -  BASED 
PROBLEM  SOLVING  SYSTEM 


I 


/ - \ 

DAISY  -  ; 

DISTRIBUTED  AI  SYSTEM 

A  testbed  environment  for  developing 
and  experimenting  with  distributed 
artificial  intelligence  systems. 

! 

HARDWARE: 

a  network  consisting  of  a  mixed  set 
of  LISP  machines 


SOFTWARE: 

SIMULACT  -  a  generic  simulation  tool 
for  simulating  multiple, 
semi-autonomous  actors  on  one  or 
more  machines 

GUS  -  a  graphical  user  interlace  for 
describing  structural  knowledge 
about  communications  svstems 
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RESEARCH  STATUS 


Domain  Analysis 

completed  implementation  of  tool  for 
acquisition  of  structural  knowledge 


completed  initial  stage  of  knowledge 
acquisition  for  a  DCS  model  network 

near  completion  of  problem  soh  ing 
specifications 


System  Design 

completed  high-level  architecture 

developed  problem  solving  strategy 
for  cooperative  service  restorai 
based  on  "multistage  negotiation" 

investigating  issues  of  distributed 
knowledge  base  maintenance 
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DYNAMIC  SERVICE  RECONSTITUTION 

in  a 


DIGITAL  BACKBONE  NETWORK 


RADC 
July  1,  1987 


Robert  Fish 

Director  of  Systems  Engineering 
Federal  Systems  Division 


Network  Equipment  Technologies 
8300 Boone  BNd  Ste.  280 
Vienna,  Va  22180 
703-556-7740 


MAJOR  LOGICAL  LAYERS 
of  an  IDN 


COMMUNICATIONS 


SYSTEMS  MANAGEMENT 

FUNCTIONS 


PLANNING 

needs  analysis  (user,  network,  etc) 
technology  tracking  &  assessment 
network  design 

OPERATIONS 

network  monitoring 
service  restoraJ 
problem  tracking 

MANAGEMENT 

configuration  control 
service  provisioning 
service  level  monitoring 

ADMINISTRATION 

accounting 
inventory  tracking 
contracts  support 
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EQUIPMENT  TECHNOLOGIES 
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TRANSMISSION 

RESOURCE 

MANAGER 

A  computer  controlled,  high-speed 
circuit  switching  device  that  combines 

the  following  elements: 

time  division  multiplexing 
matrix  switching 
digital  cross  -  connection 
voice  processing 

to  allow  maximum  bandwidth  utilization 
forvoice,  data,  image,  and  video  applications. 
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ESSENTIAL  HARDWARE  DESIGN 
CHARACTERISTICS  of  a  SURV1VABLE 


TRM. 


ROBUST  ARCHITECTURE 

failure  compartmentalization 
redundancy  of  critical  components 
ease  of  maintenance 
ease  of  expansion 

DISTRIBUTED  PROCESSING 

onboard  computer 
multi  -  processor 
EAROM  configuration  database 
downline  loadable  software 


CENTRALIZED  CONTROL 

simplified  operator  interface 
realtime  alarm  reporting 
board  level  remote  diagnostics 
comprehensive  statistics 
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ESSENTIAL  LOGIC  CAPABILITIES 


of  a  SURVIVABLE  TRM. 


Sophisticated  Operating  System 

self -checking 
fault  tolerant 
rapid  call  processing 
extensive  diagnostic  hooks 


Software  Defined  Configuration 

node  parameters 
port  characteristics 
trunk  attributes 


Efficient  Bandwidth  Management 

demand  assigned  circuits 
channel  prioritization  (with  preemption) 
integral  voice  compression 
sub  -  rate  data  multiplexing 


Common  Channel  Signaling 

reaJtime  topology  maintenance 
look  -  ahead  call  setup 
ISON  positioning 
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CALL  CONTROLLER  TASKS 


CIRCUIT  ESTABLISHMENT 

recognize  port  activation 

determine  port  speed/routing  requirements 

determine  optimal  path 

establish  circuit 


CIRCUIT  RESTORATION 

teardown  affected  circuits 
prioritize  according  to  port  parameters 
determine  optima!  new  path 
establish  circuit 


TOPOLOGY  MAP  MAINTENANCE 


monitor  attached  links 

pass  on  own  TM  checksum 

update  TM  based  on  received  checksum 


CONFIGURATION  DATABASE 


SIMPLIFIED  (graphics  based)  OPERATOR  WORKSTATION 


Network  Management  for  the  DCS 


System  description,  environment 


The  Expert  Tech  Controller 


Management  of  the  Defense  Switched  Network 
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The  Defense  Communications  System 

0  Worldwide  comm  services  for  MilDeps 

-  Circuit— switched  voice  system 
—  AUTOVON  (since  1950s) 

—  Now  in  transition  to  DSN 

-  Dedicated  circuits 

-  Defense  Data  Network 

-  Various  special  networks 

^  Dual  objectives 

—  Reliable  crisis,  wartime  communications 
—  Economical  peacetime  operation 

^  Hierarchical  worldwide  control  structure 

-  Greatly  improved  status,  performance 

data  gathering  system  in  development 

-  Serious  needs  for  n/w  management  aids 


DSCSOC 


Eauth 

Terminal 


Glossary  of  Terms 


DCAOC: 

ACOC: 

RCOC: 

SRCF: 


DCA  Operations  Center  (Washington,  DC) 

Area  Communications  Operations  Center 
(e.g.,  European,  Pacific  theaters) 

Regional  OC  (e.g.,  about  15-20  in  Eur) 

Sub-Regional  OC  (several  per  region) 


DSCSOC:  Defense  Satellite  Communications  OC 
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DCS  Net  Management  Problem  Areas 
Complexity  of  modern  nets,  equipment 

Enormous  data  reduction,  interpretation  load 

-  Recognition  of  incipient  problems 

Shortage,  loss  of  skilled  personnel 

-  Cost  of  training 

-  Lure  of  civilian  jobs 
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Application  of  Expert  Systems  Technology 
%  Tech  Control 

-  Foundation  layer  of  control  hierarchy 

-  Highly  skill-,  manpower-intensive 

%  Defense  Switched  Network  management 

-  Regional,  sub-regional  levels 

-  Network  currently  being  implemented 

—  Much  greater  range  of  net  mg't  options 
—  No  experience  base 
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DSN  System  Control:  Simulation  Techniques 


and  Expert  Systems 


#  Requirements  and  Objectives 

-  Environment 

-  Functionality 


Use  of  existing  Call-by-Call  Simulator 


Expert  System  for  network  management 
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New  Elements  in  the  DSN  Control  Environment 

Large  numbers  of  switches,  various  types 

-  More  complex  topology  than  AUTOVON 

-  More  connectivity  choices  for  alt  routing 

-  Greater  tolerance  for  loss  of  switches 

Stored  program  control  (SPC) 

-  Extensive  performance  data  collection 

-  Flexible  routing,  preemption  mechanisms 

-  Large  repertoire  of  control  options 

Common-channel  signalling  (CCS) 

-  Ample  bandwidth  for  monitoring,  control 

DCOSS  structure 
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The  Problems 

We  do  not  know  how  to  control  the  DSN 

-  Cannot  extrapolate  from  AUTO  VON 

-  Highly  skill-  and  judgment-intensive  req'ts 

—  Analyze  information  flow  from  DCOSS 

—  Recognize  problems  before  they  become 

significant 

—  Understand,  apply  correct  controls 

—  Remove  controls  as  soon  as  possible 

We  cannot  risk  slowly  learning  by  experience 

-  DSN  is  already  being  implemented 

-  Disastrous  failures  are  possible 

When  we  do  develop  skilled  controllers,  we 
will  be  unable  to  retain  them 
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Work  in  Progress  Toward  Solutions 

Major  enhancements  of  Call-by-Call  Simulator 

-  Originally  developed  for  routing  studies 

-  Congestion,  failure  models  now  being  added 

-  Incorporation  of  system  control  facilities 

Experimental  development  of  DSN  control 
knowledge 

-  Creation  of  crisis/damage  scenarios 

-  Identification  of  premonitory  patterns  of 

failure 

-  Exploration  of  control  actions,  effects 

Permanent  retention,  presentation  of  the 
knowledge  in  an  Expert  System 

-  Initial  application:  operate  simulator 

-  Subsequent  role:  aid  DSN  managers 
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Communication  Between  a  Distributed  Operating  System 
and  the  Network  Management  System  of  a 
Wide  Area  Network 

Tnis  oresentaron  win  discuss  tne  prooiems  involved  wtr  .,,<,ng  a  »  ;e  at*  a 
Network  (wan*  'or  communications  in  a  Districted  Coerating  ivsten  CCS  - 
The  metnodo’og/  for  aoorcacmng  t.vs  croc  err  »rV  oe  presorted  a.  arc  *  :r 
a  description  or  the  DCS  and  -ow  re  wan  fit's  r.to  :ne  system  -rc:c:: 
relationships  cetween  re  DC:  arc  w an  w.-:  ce  presentee  a'c* ;  a 
discussion  of  approaching  tie  .ntercormumcarors  r.eeds  -si-g  Me  Network 
Management  System  vMi$)  s mai'v  example  uses  of  tne  wan  :v  re  DCS 
along  with  tne  potenfal  for  NMS  information  wi?i  oe  descried 

Presented  By  William  T  Etter 
QfiS  Associates 
P  0  30x  4297  „ 
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DOS/WAN  System  Concept 
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AN  INTELLIGENT  C3  TERMINAL  CONCEPT 

J.  W.  FORGIE 

MIT  LINCOLN  LABORATORY 
2  JULY  1987 
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SYSTEM  ENVIRONMENT  FOR  INTELLIGENT 

C3  TERMINAL 


THE  INTELLIGENT  C3  TERMINAL  (ICT) 
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EXTENDED  ICT  ARCHITECTURE  FOR  COMMAND 

CENTER  APPLICATION 


COMMAND  CENTER  EXTENSION  OF  ICA  CONCEPT 


PROTOCOL  ISSUES 
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ICA  ISSUES 


MISSION 

of 

Rome  Air  Development  Center 

RAPC  plant  and  execute 4  x.etea> ich,  development,  tett 
and  telected  acquitition  pA.ogx.amt  -in  tuppoxt  oh 
Command,  Control,  Commun-icat-iont  and  Intelligence 
(C^I)  actio itiet .  Technical  and  engineering 
tupport  within  areat  o&  competen ce  it  provided  to 
ESV  Vx.ogn.am  Q^ic&t  { POt )  and  other  ESV  elementt 
to  perhorm  ehhective  acquitition  0|$  C3 1  tyttemt. 

Thz  axzat  oh  technical  competence  includz 
communication ,  command  and  control,  battle 
management,  inhormation  procetting ,  turveillance 
tentort,  intelligence  data  collection  and  handling, 
tclid  ttate  tciencet,  electro  magnet ict  ,  and 
propagation,  and  electronic,  maintainability , 
and  compatibility. 


